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(54) PICTURE RECOGNITION DEVICE 

(57)Abstract: 

PURPOSE: To attain picture recognition with high 
reliability by processing a picture based on a picture 
inputted with a correct luminance distribution. 
CONSTITUTION: A diaphragm control means 10 
changes a diaphragm means 2 to receive a picture 
signal of a predetermined luminance suitable for signal 
processing and a background picture is read to a 
background picture memory section 4. Then the 
diaphragm control means 10 keeps a setting value of the 
diaphragm means 2 to read a current picture to a current 
picture memory section 3, a difference binarization 
means obtains a difference between the current picture 
memory section 3 and the background picture memory 
section 4 and applies thresholding to the difference to 

extract and recognize an object. A luminance distribution measurement range limit means 9 
limits an area from which a predetermined luminance distribution is obtained to a range 
required for recognition control, the calculation quantity is reduced to quicken the speed of 
arithmetic operation. Moreover, the diaphragm setting value is stored in a nonvolatile memory 




1 1 and the diaphragm setting value is stored before power interruption to reduce the time till 
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the background picture of a predetermined luminance distribution is stored again. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3 in the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to the image recognition equipment which extracts a body 

from an image and is recognized. 

[0002] 

[Description of the Prior Art] The image recognition equipment of the method which extracts this 
conventional kind of body by the image asked the body extract for the subtraction -image screen C of the 
background-image screen A and the present image screen B, as shown in .drawing.6 , and an image 
extract means to extract a body 19 from the subtraction-image screen C was used for it. the 
configuration was shown in drawing 7 -- as ~ the image input means 1 ~ a background image ~ the 
background-image memory section 4 - memorizing ~ the image of the present next ~ the present image 
memory section 3 - memorizing ~ after that and difference - the binary-ized means 5 ~ the difference 
of the present image memory section 3 to the background-image memory section 4 ~ after calculating, it 
was what is referred to as making it binary and taking out an objective configuration. 
[0003] Moreover, when a diaphragm of a lens was always adjusted according to the intensity level of the 
image inputted and an image pick-up image was copied for a receiving set according to the device of the 
so-called auto iris, he was trying to keep the whole brightness constant in conventional image pick-up 
equipment, for example, a video camera. 
[0004] 

[Problem(s) to be Solved by the Invention] However, when the configuration of the auto iris of the 
above-mentioned conventional image pick-up equipment was adopted as image recognition equipment 
as it is and the luminance distribution of a screen is changed depending on the magnitude of the person 
who moves in a screen, a location, etc., a diaphragm of a lens changes, and the amount of incident light 
is changed so that the luminance distribution of a screen may be kept proper. That is, the partial 
fluctuation in a screen affects the whole screen, therefore, between the present image memory section 
and the background-image memory sections ~ difference - when it is going to calculate and is going to 
extract a body, a changed part of the brightness of the present image will also be accidentally extracted 
as a body. Therefore, when a device was controlled by image recognition, the device may have 
incorrect-operated. 

[0005] This invention solves the above-mentioned technical problem, and predetermined luminance 
distribution is secured at the time of an image input, and it sets it as the first purpose to recognize a body 
correctly. 

[0006] Moreover, it sets it as the second purpose to set up the luminance distribution of a field required 
for recognition the optimal. 

[0007] Moreover, it sets it as the third purpose to set a proper luminance distribution value as a power 

up quickly. 

[0008] 

[Means for Solving the Problem] A diaphragm means to adjust the quantity of light which carries out 
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incidence to an image input means and an image input means in order that this invention may attain the 
first purpose of the above, The background-image memory section which memorizes a background 
image from the output signal of an image input means, the difference made binary in quest of the 
difference of the present image memory section which memorizes the present image, and the present 
image memory section and the background-image memory section from the output signal of an image 
input means — with a binary-ized means The luminance distribution measurement means and the criteria 
luminance distribution setting means of measuring the luminance distribution of the data of the 
background-image memory section, and the diaphragm control means which controls a diaphragm 
means are established. 

[0009] Moreover, in order to attain the second purpose, a measuring -range limited means of luminance 
distribution to restrict the field which carries out luminance distribution measurement is established. 
[0010] Moreover, in order to attain the third purpose, the nonvolatile memory which has memorized the 
diaphragm-setting value also at the time of power off is prepared. 
[0011] 

[Function] this invention is the above-mentioned configuration, the picture signal of the predetermined 
brightness which it extracted by the diaphragm control means, and the means was changed, and was 
suitable for signal processing is incorporated, a background image reads into the background-image 
memory section, and the present image reads into the present image memory section, extracting by the 
diaphragm control means and holding the set point of a means after that, — and difference ~ it makes 
binary with a binary-ized means in quest of the difference of the present image memory section and the 
background-image memory section, and a body extracts and recognizes. 

[0012] Moreover, the field which searches for predetermined luminance distribution is limited to the 
range required for recognition control with the measuring-range limited means of luminance 
distribution, and the rate of an operation is gathered by lessening computational complexity. 
[0013] Moreover, by memorizing a predetermined diaphragm-setting value to nonvolatile memory, and 
memorizing the diaphragm-setting value before ** also in the time of power off, the diaphragm-setting 
value when switching on a power source again is promptly returned to the condition before power off, 
and time amount until it memorizes the background image of predetermined luminance distribution 
again is shortened. 
[0014] 

[Example] Hereafter, one example of this invention is explained with reference to a drawing. 
[0015] An image input means by which drawing 1 is the block diagram of the image recognition 
equipment of one example of this invention, and 1 picturizes a body, A diaphragm means by which 2 
adjusts the light income of the image input means 1, the present image memory section 3 remembers the 
present image to be, the background-image memory section 4 remembers a background image to be, and 
the difference to which 5 performs binary-ization with difference between the present image memory 
section 3 and the background-image memory section 4 — a binary-ized means ~ 6 ~ difference ~ an 
appliance control means to control an external instrument by the output of the binary-ized means 5 ~ A 
luminance distribution measurement means by which 7a measures luminance distribution from the data 
of the present image memory section 3, An average measurement-of-luminance means by which 7b 
measures average luminance from the data of the present image memory section 3, A criteria luminance 
distribution setting means by which 8a sets up predetermined luminance distribution, a criteria average 
luminance setting means by which 8b sets up predetermined average luminance, A measuring-range 
limited means by which 9 limits luminance distribution measuring range, the diaphragm control means 
by which 10 controls the diaphragm means 2, and 1 1 are nonvolatile memory which memorizes the 
initial value of the drawing means 2 at the time of a background-image input. 
[0016] The actuation in the above-mentioned configuration is explained based on drawing. The 
following explanation explains luminance distribution measurement means 7a as that for which average 
measurement-of-luminance means 7b is used, and criteria luminance distribution setting means 8a also 
uses criteria average luminance setting means 8b. 

[0017] Drawing 2 is the flow chart of actuation of this image recognition equipment. If a power source 



http://www4.ipdl.jpo.go.jp/cgi-bin/tran_web_cgi_ejje 4/5/04 



Pages of 4 



is switched on, it will extract at step 101 and a setting O.K. flag will be set as 0. Next, it extracts at step 
102, and if a setting O.K. flag investigates whether it is 1 and becomes one, it will fly to step 109. On 
the other hand, if a diaphragm setting O.K. flag is not 1, it will extract from nonvolatile memory 1 1 at 
step 103, a value will be read, and the drawing value will be set as the diaphragm means 2. Next, it flies 
to step 102, after input a background image into the background-image memory section 4 from the 
image input means 1 at step 104, calculating average luminance by average measurement-of-luminance 
means 7b at step 105, extracting if it judges whether a setup was made to the optimal drawing value set 
up by criteria average luminance setting means 8b at step 106 and is the the best for it, and setting a 
setting O.K. flag to 1 . On the other hand, if the setup has not got used to the optimal drawing value, it 
will return to step 104 through the drawing value modification process of step 108. Step 107 extracts 
from step 104 and it is a value setting process. Now, in step 109, it extracts, a value is written in 
nonvolatile memory 1 1, and the image which extracted and was set up in the value setting process 12, 
which was set as the optimal drawing value and which extracted and was inputted into the image input 
means 1 through the means 2 is written in the background-image memory section 4 at step 110. Next, 
the image inputted into the image input means 1 at step 1 1 1 is written in the present image memory 
section 3. next, the step 112- between the background-image memory section 4 and the present image 
memory sections - difference ~ a binary-ized operation ••- carrying out ~ step 1 13 - difference ~ with 
the output of a binary-ized means, appliance control is performed and actuation from step 1 1 1 to step 
1 13 is repeated henceforth. 

[0018] Drawing.! is what showed the drawing value modification process of step 108 of drawing,! with 
the flow chart, and when large, it judges whether it is larger than predetermined brightness at step 201, 
and it extracts at step 202 and one step of value is enlarged (reducing the quantity of light), and when 
small, it extracts at step 203, one step of value is made small (increasing the quantity of light), and it 
goes to work [ of a degree ] after that. 

[0019] In addition, in case it judges whether average luminance reached the optimum value at step 106, 
it cannot be overemphasized that it judges it not only judges that it is surely in agreement with a value 
with brightness, but that it is within limits with an image processing possible in which. 
[0020] since the image of brightness proper at the time of a background-image setup can be written in 
the background-image memory 4 by the flow of the configuration shown above and processing and the 
present image can be henceforth captured in the present image memory section 3 with the proper 
diaphragm set point at the time of the present image input ~ difference ~ the output of the binary-ized 
means 5 is also right, a dynamic body can be extracted, and control of the external instrument by the 
appliance control means 6 can also be ensured. 

[0021] Drawing 4 is what showed the average measurement-of-luminance process of step 105 with the 
flow chart, measures the average luminance in the field which restricted the field which asks for a 
brightness average with the measuring-range limited means 9 at step 301, and was restricted at step 302 
with an average measurement-of-luminance means, and goes to work [ of a degree ]. The brightness of a 
part required for control of a device can be setup the optimal by this processing. For example, it sets in 
the configuration which recognizes by the image whether a man 14 exceeds one boundary line 15 in the 
present image screen of dmwing„5 (moving downward from on a screen), and controls a device. If it 
asks for the average luminance in the detection field 18 which did not need to ask for the brightness 
average of the whole screen at the time of a background-image setup, and was surrounded by two 
surrounding lines 16 and 17 of a boundary line 15, are enough, moreover, difference - since the data 
processed by limiting binary-ized processing to the detection field 18 can be lessened, it becomes 
possible to raise processing speed. In the example of drawing 5 , since a detection field is set to one third 
of all fields, computation time is also mostly set to one third. 

[0022] Moreover, since it will extract from nonvolatile memory at the time of a background-image setup 
of the power up from next time, it will read a value and a background-image setup will be performed 
with the value by saving the proper diaphragm value at nonvolatile memory 1 1, if the brightness of a 
picture-input-device installation is not changing a lot, it can escape from the diaphragm value setting 
process 12 by comparatively small loop count, and can come out. Therefore, it becomes possible to 
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perform a background setup quickly, and the prompt appliance control after powering on becomes 
possible. 

[0023] Although it has gone ahead with the talk noting that its attention is paid to the distribution to 
which the average luminance in an object screen becomes predetermined magnitude as a means to 
search for proper luminance distribution by the above explanation Proper luminance distribution is not 
necessarily restricted to the above-mentioned distribution, and can consider various distribution, such as 
distribution to which the peak price of the brightness in an image turns into constant value, and larger 
distribution than a value with the minimum value, and selection use is suitably carried out by the 
objective extract approach, the control approach of an external instrument, etc. 

[0024] In addition, although it expressed with the block diagram of drawing 1 so that it might be the so- 
called mechanical shutter with which it extracts and a means operates mechanically, in the image 
recognition equipment which used an image input means like the video camera which used CCD 
(charge-coupled device), it is also possible to realize as the so-called electronic shutter which controls 
the charge accumulated dose of CCD for a diaphragm means, and adjusts the output value from CCD. 
[0025] 

[Effect of the Invention] According to the image recognition equipment of this invention, the following 
effectiveness is acquired as explained above. 

[0026] (1) Since the image processing is carried out based on the image inputted by proper luminance 
distribution, rehable image recognition can be performed. 

[0027] (2) Since image recognition is carrying out the image processing based on the image which 
limited the required field and was inputted by the optimal luminance distribution for the field, it is 
reliable and a high-speed image processing can be realized. 

[0028] (3) making nonvolatile memory memorize the diaphragm value which sets an image as the 
optimal luminance distribution ~ the set point of last time [ power up ] ~ using - initial brightness part 
construction - a law is made and it can go into image recognition quickly. 



[Translation done.] 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

LDrawing„lJ The block diagram showing the configuration of the image recognition equipment in one 
example of this invention 

IDrawing„2] The flow chart of the image recognition of this equipment 

[Drawing 3] The flow chart of drawing value modification of this equipment 

[Drawing 4] The flow chart of average luminance count of this equipment 

[Drawing S] The conceptual diagram of a recognition field limit of this equipment 

.CDrawing..6]. The conceptual diagram of body detection of conventional image recognition equipment 

IDiawingV] The block diagram showing the configuration of this equipment 

description of Notations] 

1 Image Input Means 

2 Drawing Means 

3 The Present Image Memory Section 

4 Background-Image Memory Section 

5 Difference ~ Binary -ized Means 

7a Luminance distribution measurement means 
7b Average measurement-of-luminance means 
8a Criteria luminance distribution setting means 
8b Criteria brightness setting means 

9 Measuring-Range Limited Means 

10 Throttling Control Means 

1 1 Nonvolatile Memory 



[Translation done ] 
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